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Abstract 

We consider a queuing model with the workload evolving between consecutive i.i.d. ex- 
ponential timers {eq'^}i=i^2,... according to a spectrally positive Levy process Yi(t) that is 
reflected at zero, and where the environment i equals or 1. When the exponential clock 
e^*^ ends, the workload, as well as the Levy input process, are modified; this modification 
may depend on the current value of the workload, the maximum and the minimum workload 
observed during the previous cycle, and the environment i of the Levy input process itself 
during the previous cycle. We analyse the steady-state workload distribution for this model. 
The main theme of the analysis is the systematic application of non-trivial functionals, de- 
rived within the framework of fluctuation theory of Levy processes, to workload and queuing 
models. 

1 Introduction 

In this paper we focus on a particular queuing system with state-dependent two-stage regulation 
mechanism. There has been considerable previous work on queues with state-dependent service 
and arrival processes; see for example the survey by Dshalalow [9] for several references. The 
model under consideration involves a reflected Levy process connected to the evolution of the 
workload. Special cases of Levy processes are the compound Poisson process, the Brownian 
motion, linear drift processes, and independent sums of the above. 

Specifically, in this paper we consider a storage/workload model in which the workload 
evolves according to a spectrally positive Levy process Yo{t) or Yi{t), both reflected at zero. 
That is, let Xi{t) {i = 0,1) be two independent spectrally positive Levy processes (i.e. Levy 
processes with only positive jumps) modelling the input minus the output of the process and 
define — inf^^o -^i('S) = and Xi{0) = x ^ 0. Then we have that Yi(t) = Xi[t) — \n.is^tXi{s) 
(where 1^(0) = x for some initial workload x ^ 0). In addition, at exponential times with 
intensity q, given by {e^ ^}.j=i^2,...) the workload is "reset" to a certain level, depending on 
the workload level just before the exponential clock ends, its minimum and maximum in the 
previous cycle, and the environment of the reflected Levy process. Specifically, at epoch t = 
ef^ + ■■■ + e^^\ the workload V{t) equals F^n\v{t-)) for some random nonnegative i.i.d. 
functionals F„ : [0, oo) x {0,1}^ — )■ [0, oo) x {0,1}, where Fn"* and F^^^ denote the first and 
second coordinate of F^, respectively. Moreover, at these moments the feedback information is 
available and the label of the Laplace exponent is changed according to functional -F^^-* . 
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This model unifies and extends several related models in various directions. First, in a 
previous paper [21], we considered the case where Xq = Xi, and where the workload correction 
depended on the current workload only. Second, if Xq = Xi = X is a compound Poisson process 
and if F„ is the identity function, then our model reduces to the workload process of the M/G/1 
queue. Next, Kella et al. [14] considered a model with workload removal, which fits into our 
model by taking Fn{x) = and by letting the spectrally positive Levy process Xq = Xi = X 
be a Brownian motion superposed with an independent compound Poisson component. Our 
work is also related to papers [3, 4], who considered the adaptation of the Laplace exponent of 
the input process at the moments when the workload process crosses level K. Bekker et al. [4] 
analysed also the adaptation of the process at Poisson instants but without the possibility of 
additional regulation at these moments and without taking into account the supremum of the 
workload process between exponential timers. 

The model we consider can be also seen as a Levy-driven queue. Queues and Levy processes 
have received significant attention recently, as described in the excellent survey by D§bicki and 
Mandjes [8]. Indeed, a point of this paper is that one can use the joint law of a reflected Levy 
process at an exponential time as well as it supremum and inflmum to effectively analyse queu- 
ing and inventory models where specific workload corrections take place based on whether an 
extremely high and/or low workload has been reached since the previous point of inspection. 
We discuss several examples to illustrate this point. In addition, we derive two types of qualita- 
tive results. We prove stability by showing that an embedded Markov chain is Harris recurrent. 
The proof involves analysing the two-step transition kernel. In addition, we consider the tail 
behavior of the invariant distribution, building on results in [21]. The examples for which we 
analyse the entire distribution are, respectively, a clearing-type model, a model related to the 
TCP protocol, and an inventory model. 

The paper is organised as follows. In Section 2 we demonstrate model we deal with. In 
Section 3 we introduce a few basic facts concerning spectrally positive Levy processes. In 
Section 4 we consider the embedded workload process and derive a recursive equation for its 
stationary distribution. By the PASTA property this determines the steady-state workload 
distribution. Later on, in Section 5 we present some special cases. Finally, in Section 6 we focus 
on the tail behaviour of the steady-state workload. 

2 Model description 

We consider a Levy input model, with the additional feature that at exponential (g) times both 
the input process and the workload can be corrected. 

Let Cq^ be an i.i.d. sequence of exponential {q) random variables. Let Sn = + • • • + 
and let N{t) = max{n : Sn ^ t} he a Poisson process with rate q. At times Sn, n ^ 1, 
inspection takes place by a controller, who can decide to change the workload input for the 
interval [Sn,Sn+i), as well as the workload level itself. In any given interval [Sn,Sn+i), the 
workload process V{t) is driven by a spectrally positive Levy process with Laplace exponent ipo 
or ipi, depending on the choice of the controller at time Sn- 

Apart from the workload level V{t), the choice of the controller can depend on the following 
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quantities: let K and L be two constants, called the upper and lower threshold and define 

Js{t) = l{ sup V{r)^K), 




JE{t) G {0,1}, 

W{t) = {V{t),Js{t),Jl{t),JE{t)). 

During [Sn, Sn+i), y{t) is driven by a spectrally positive Levy process with exponent '4)j^(t). 
At time 5^+1 — , the workload level and the input process are modified according to a random 
function : [0, oo) x {0,1}'^ [0, oo) x {0,1}, where and denote the first and 

second coordinate of -F^+i, respectively. Specifically, the workload at time Sn+i becomes 

y(S„+i) = Fi^i(M^(5„+i-)), 
and the Laplace exponent of the Levy input process JE{Sn+i) becomes 

JE{Sn+l)=F'^l^{W{Sn+l-)). 

The idea of the analysis is as follows. We are interested in the steady state distribution of 
the process we have just defined. By PASTA, it suffices to analyse the embedded Markov 
chain Wn = W{Sn-) =: {Un, Jn) with Jn = ( Js(S„-), J7(5„-), J^j (n ^ 1). Thus, 
Un = V{Sn — )- The transition kernel of this Markov chain can be computed by building on 
various recent results on reflected spectrally one-sided Levy processes. The next section will 
focus on this. 

The remainder of this section mentions some illustrative examples of the function F = Fi. 
Let n ^ and j = {ji,j2,j3)- Examples on how one may change the workload are: 

1. fW {u,j) = Bj (this includes clearing models, where Bj = 0, considered in Kella et 
al. [14]); 

2. F^^\u,j) = u + Bj (inventory models where additional goods are ordered, for example 
R units are ordered if the inventory has dropped below a specific value L, leading to 
B- = R-l{j2 = l)); 

3. F^^\u,j) = {Bj — u)~^ (considered in Vlasiou & Palmowski [21]); 

4. F^^\u,j) = u ■ l(j2 = 0) + • l(j2 = 1) (set inventory to level R if it drops below L and 
do nothing otherwise). 

Examples one could think of for the second coordinate are of the type that input is slowed down 
when a high level is reached, and/or speed up when a low level is reached. Suppose that Yi{t) 
represents a high input with respect to lo(0- Then, examples of how to modify the second 
coordinate are: 

1. F(^)(ii, ji, 1, J3) = 1, i<'(^)(u, ji, 0, js) = (choose high input if the workload was below L 
and choose low input otherwise); 

2. F(^^(ii, 1, j2, js) = 0, F(^)(ti, 0, j2, js) = 1 (choose high input if the workload did not exceed 
K and choose low input otherwise); 

3. F^'^\u,ji,j2,j3) = 1(^ < K) (choose high input iff the workload was less than K); 
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4. ji, j2, js) = is (never change environment). 

In Section 5, we investigate a subset of these combinations. Additionally, we consider the 
case F^^\u,j) = 5u (TCP). Further examples can be found in the literature, in particular in 
[3, 4]. Note that in some of the models considered in those papers, the workload is adapted 
instantaneously when a high level is reached, rather than after an exponential time. In principle 
one could recover such results from our model by letting gr — > oo. 

3 Preliminaries on Levy processes 

Let Xi{-)^ i = 0, 1, be two spectrally positive Levy processes. Throughout this paper we exclude 
the case where the Levy processes Xi have monotone paths. Let the dual process of Xi{t) be 
given by Xi{t) = —Xi{t). The process {Xj(s),s ^ t} is a spectrally negative Levy process and 
has the same law as the time-reversed process {Xi{{t — s)—) — Xi{t),s ^ t}. Following standard 
conventions, let X_i{t) = inis-^t Xi{s), Xi{t) = sup^^^ Xi{s) and similarly X_i{t) = mis<^t Xi{s), 

and Xi{t) = supg^^ Xi{s). One can readily see that the processes Yi{t) = Xi{t) — X_i{t) (for 
Yi{{)) = 0) and Xi{t) (where Xj(0) = 0) have the same distribution; see e.g. Kyprianou [15, 
Lemma 3.5, p. 74]. Moreover, 

-X,(t)^l,(t), x,(t)^-Ut)- 

Since the jumps of Xi are all non-positive, the moment generating function E[e^^'-^^'>\ exists 
for all ^ ^ and is given by ^[e^'''"'^*)] = e*'^'^^^ The Laplace exponent V'i(^) is well defined at 
least on the positive half-axis where it is strictly convex with the property that lim5i_!.oo V'i(^) = 
+O0. Moreover, ipi is strictly increasing on [<l>j(0), oo), where $i(0) is the largest root of ipi{9) = 
0. We shall denote the right-inverse function of ijji by $j : [0, oo) — > [$(0), oo). 

Denote by cjj the Gaussian coefficient and by z/j the Levy measure of Xi (note that ai is also 
a Gaussian coefficient of Xi and that nj(^) = Vi{—A) is a jump measure of Xi). Throughout 
this paper we assume that the following (regularity) condition is satisfied: 

(Tj > or / xi'i{(ix) = oo or Ui{dx) << dx (3-1) 

for z = 0, 1, where << dx means absolutely continuity with respect to the Lebesgue measure. 
Finally, Pi^x denotes the probability measure P under the condition that Je(0) = i for the label 
process Je, Xi{Qi) = x, and Ei^^ indicates the expectation with respect to Pi^x- If Xi{0) = we 
will skip the subscript x. 

3.1 Scale functions 

For g ^ and i = 0, 1, there exists a function wj^''^ : [0, oo) [0, oo), called the q-scale function, 
that is continuous and increasing with Laplace transform 

POO 

/ e-'ywi'\y)dy = (MO) - > Mq)- (3.2) 

Jo 

The domain of VF/'^^ is extended to the entire real axis by setting wj;'^\y) = for y < 0. We 

mention here some properties of the function wj^'^^ that have been obtained in the literature 
which we will need later on. 

On (0, oo) the function y i-^ wj^''\y) is right- and left-differentiable and, as shown in [18], 
under condition (3.1), it holds that y i-^ W^'^\y) is continuously differentiable for y > 0. 
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Closely related to VF/"^^ is the function Z-'^-* given by 



Z\''\y) = l+q /V, 
JO 



z)dz. 



The name "g-scale function" for W- '^^ and Z^'^^ is justified as these functions are harmonic for 
the process X killed upon entering (—00,0). Here, we give a few examples of scale functions. 
For a large number of examples of scale functions see e.g. Chaumont et al. [7], Hubalek and 
Kyprianou [13], Kyprianou and River o [17]. 

Example 1. If X{t) = Xi{t) = X2{t) = aB{t) — fit is a Brownian motion with drift fi (a 
standard model for small service requirements) then 



where S = a ^A//?+2g(T^ and lo = fi/a"^- 
Example 2. Suppose 

N{t) 

X{t) = Xi{t) = X2{t) = ai-pt, (3.3) 

i=l 

where p is the speed of the server and {ai} are i.i.d. service times that are coming according to the 
Poisson process N{t) with intensity A. We assume that all cjj are exponentially distributed with 
mean l/fj.. Then ^j^O) = pO-Xe/ifi + O) and the scale function of the dual = w['^^ = W^'^'' 
is given by 

W^'i\x) = p'^ f^+e''^('')^ - A_e''"(5)^) , (3.4) 



where A± = g+^^^^'^g^-jg) with q^{q) = ^{q) and q {q) is the smallest root of V'(^) = T- 



^ _ q + X - HP± ^/{q + X - fip^ + Apqp 



2p 

3.2 Fluctuation identities 

The functions W-'^^ and Z^-''^ {i = 0, 1) play a key role in the fluctuation theory of reflected 
processes as shown by the following identity (see Bertoin [5, Th. VII. 4 on p. 191 and (3) on p. 
192] or Kyprianou and Palmowski [16, Th. 5]). 



Lemma 3.1. For a > 0, 



which is equivalent to 



^^ (q) («) - q) ' 



P{Xi{eq) G Ax) = -^^Wl''\dx) - qWl''\x)dx, x > 0. 

[q) 

Moreover, —Xi{eq) follows an exponential distribution with parameter ^{q). 
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Let Tjf^ = mf{t ^ : Xi{t) < 0}. The q-scale function gives also the density r^^\x,y) = 
rI''\x , dy) / dy of the g-potential measure 

R^\x,dy) := r e~i'Pi,^(Xi{t) € dy,T° > t)dt (3.5) 
Jo 

of the process Xi killed on exiting [0, oo) when initiated from x; see also Pistorius [22] and 
Palmowski and Vlasiou [21]. 



Lemma 3.2. Under (3.1), we have that 



li\x,y) = I e-*'('?)^ W'^'(y -x + z)- ^,{q)w'>''\y - x + z) 

J[{x-y)+,x\ 



dz. 



Remark. Lemma 3.2 and similar results can be proven without the assumption made in (3.1), 
but at the cost of more complex expressions. We would have to use (3.5) instead of the much 
nicer form for r^^\x^y)dy. 

Lemma 3.2 implies the following useful formula describing the density of the reflected Levy 
process at an exponential time, which is taken from [21, Lemma 3.1]. 

Lemma 3.3. We have that Pi,x{Yi{eg) G dy) = /ii(x, y)d2/ + e-*('')^w/''^(0)5o(dy), where 
hi{x,y) = qrl'^\x,y)+e~''^^''> 



— W,^'^'iy)-qW,^'\y) 



and where r^'^\x,y) is given in Lemma 3.2. 

We need an extension of this result, proved by Pistorius [22, Th. l(ii), p. 99]. 
Lemma 3.4. Under (3.1), we have that 

PiAYM e dy, sup Yi{s) ^ K) = q {h'flix, 0)So{dy) + h^l{x, y)dy} 

for 

hi'k-^y) = wi'\K - x)^i^ - Wl''\y - X). 



We also need the following expression for the joint law of the reflected process and its 
infimum, which follows directly from Lemma 3.2 (after shifting the trajectory downwards by 
L). 

Lemma 3.5. Under (3.1), we have that, for x,y ^ L, 

PiAYii^q) e dy, inf Yiis) > L) = qr^^\x - L,y - L)dy. 

We are now ready to provide the formulae that will be crucial in our analysis in the next 
sections. 
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Lemma 3.6. Under (3.1), we have that: 

Ko,o,iix,dy) : = Pj,x(^j(eg) G dy, sup Yi{s) ^ K, inf Yi{s) > L) 



wi^\K-L) 



rig), 



dy, 



Ko,i,j(2;,dy) : = Pi,x{Yi{eq) G dy, sup Yi{s) ^ K, inf Yi{s) ^ L) 

hi%{x,0)6o{dy) + hfj.{x,y)dy - Ko,o,j(x, dy), 
Kifl^i{x,dy) : = Pi,x{Yi{eq) G dy, sup Yi{s) > K, inf Yi{s) > L) 



= qrf\x - L,y - L)dy - Ko,o,i(x, dy), 
Ki,i,i{x,dy) : = Pi,x(Yi{eg) G dy, sup Yi{s) > K, inf Yi{s) ^ L) 



S^Cq 



/i,(x,y)dy + e-*('?)^Ty/'')(0)5o(dy)- ^kU^Av)- 



k,l 

k-l=0 



(3.6) 



Proof. Equality (3.6) follows from [22, Eq. (13)] and [23]. The other three identities follow from 
the law of total probability and application of the previous lemmas. □ 



4 Equilibrium distribution of the embedded process 

Recall that [/„ = V{Sn—) and that J„ = ( J5(5'„,— ), J/(5„— ), J£;(5„— )) and define {U, J) as 
the weak limit of (C/„, J„), assuming it exists and that it is unique. The main goal is to derive 
an expression for the distribution of (JJ,J). To this end, we define the transform Vj(s) = 
E[e-'^I{J = ])]. We now derive an equation for this transform: 

P{F{U, J) edx,h; J = j) 
jG{o,i}3-"-" 

/"CXD /'OO /"OO 

= E / / / e-^%-(a;,y)P(F(n,j)G(dx,/3))P(f/Gdn;J = i). (4.1) 

Jg{0,l}3 -^^=0 •^y=0 -^"=0 

In the next section, we consider several examples for which it is possible to solve this set of 
equations. Of course, it helps if the g-scale function W^''^ is explicitly known, and in many cases 
(for example in the case of a Brownian motion superposed with a compound Poisson process 
with phase-type jumps), the g-scale function can be written as a sum of exponentials, allowing 
a tractable analysis (as illustrated by the first example in the next section). 

Before we start looking for solutions, we first determine whether a solution actually exists, 
i.e. we discuss stability conditions. Let be the drift of the Levy process i. Recall that we 
assume that our Levy processes are assumed not to be subordinators. The following assumptions 
are not the most general possible, but seem to cover most practical purposes, in particular the 
examples discussed later on. Assume there exists a constant M > and random pairs {A, B) 
such that for M ^ M and j G {0, 1}^: 

f(i)(u,j) 2 + 5 =: F"(u). (4.2) 



vj{s)= / 



h, Ji{eq-) = h 
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Also assume that F^'^\u,j) = for u ^ M and finally, assume that there exists a random 
variable Dm such that 

F«(nJ)Si5A/, ui^M, 1 = 1,2, JG{0,1}3. 

Theorem 4.1. Assume that neither Xi{-) nor —Xi(-),i = 0,1 are subordinators. Then the 
distribution of [Un, Jn) converges in total variation if one of the following conditions is satisfied: 

1. ^[log^] < 0, E\[ogDM] < oo and ^[logS] < oo; 

2. A=l, E[Dm] < oo and E[B] +mo/q< 0. 

Proof. We shall show that the process Wn = {Un, Jn) is a Harris chain. We focus on the first 
set of assumptions (the second set is similar, but easier). 

Set e = — £'[log y4]/2. Let M' > max{K, M} be a constant with the following properties: 
E[log{A + {B + Xi{eq))/x)] < — e if x > M'. Also, M' is chosen large enough such that 
P(Xi(eg) G (Af',2M')) > for i G {0,1}. Finally, M' is chosen large enough such that 
P{Dm < M') > 0. 

Define the set R = [0,M'] x {0,1} x {0,1} x {0,1}. The function f{u,j) = logn is a 
Lyapounov function for the Markov chain {Un,Jn)- For u > M' we have 

E[f{Ui, J,)\Uo = u;Jo=J]- f{u,J) ^ E[log{Au + B + Xi(e,))] - logn 

= E[log{A + {B + Xi{eg))/u)] < -e. 

If we let Dm be independent of {A, B) and define D'^j = Dm + AM' + B, we see that 

u^M', JG{0,1}3. 

In addition, £'[logD^j] < oo. The above two considerations imply that the expected return 
time to R is finite so that R is recurrent. We construct a nontrivial measure Q and constant p 
such that 

P{{U2, J2) G F I (C/o, Jo) = (n, j)) ^ pQ{F), {u,j) G R, 

which together with the fact that R is recurrent implies Harris ergodicity, cf. [2, Th. VII 3.6]. 
We define Q as follows, for F = Fq x Fi x F2 x F3 C [0, 00) x {0, 1}^, we set 

Q{F) = Po{Yo{eg) G Fo, 1 G niiF, | sup Yo{s) ^ K). 

s<eq 

To construct p, we need to create an event that guarantees the lower bound. This will be the 
intersection of several consecutive events. First we make sure we are above level M' at the end 
of the first period so that the environment J2,e is going to be equal to 0. The probability of 
this to happen is not smaller than mhii P{Xi{eq) G {M' ,2M')). Second, given that C/q < M, 
given the increase of Xj(eg), and given our assumptions on the boundedness of F^^) we arrive 
at P{Ui G (M',3M')) > P{D'j^ < M') mini P{Xi{eg) G (Af',2M)) =: pi. If Ui > M' , then 
J2,E = 1 as required. Define now 

P2 = PiASM' + B< 4M')F4A/'( inf lo(s) = 0)Po(sup Yo{s) > K), 

s<eq s<eq 

i.e. we make sure that the workload process both hits (in particular, downcrosses level L) 
and upcrosses larger than K. Observe that p2 > in view of the fact that neither the Levy 
processes nor their duals are subordinators. Defining p = piP2 then completes the proof. The 
proof in the second case is similar, taking the Lyapounov function f{u,j) = u. □ 
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This theorem does not yield optimal conditions, but it suffices for a large number of examples, 
and implies not only existence, but also uniqueness of the stationary distribution as well as 
convergence in total variation. Optimal conditions generally can be found for specific examples 
using standard techniques from the literature as surveyed for example in [11]. 



5 Examples 

We now turn to analysing a few specific examples. 



5.1 A generalised clearing model 

We start with the following simple example. We compute the case where F^^^ is given by the 
first example we have listed in Section 2 and F^^^ is given by the second example. Namely, we 
consider the following functional: 

F{u,j) = {Bj,l-n), 

where we further assume that Bj is exponentially distributed with rate /ij and that the Levy 
input processes are compound Poisson process with exponential jumps. In other words, when 
the supremum of the workload process during one cycle crossed level K, in the next cycle 
the input process will switch to the lower input process; otherwise we keep the regular input 
process in the next cycle. Notice that although we do not modify the input process based 
on the lower threshold L, we allow the correction F^^^ to depend on the whole environment 
{Js{t), Ji{t), JE{t)), and thus also on the lower threshold. E.g., one may choose an exponential 
correction with a higher mean if the lower threshold has been crossed. The input processes are 
of the type (3.3), and thus we have from (3.4) that scale functions of their duals are of the form 

T^/'^^(x) = ^i,ie5»'i" + ^,,2e''^.2" 

for each process Yi, i = 0, 1, and where the appropriate constants Aij and qij can be easily 
derived through minor modifications of the expressions in Example 2. 
From (3.4) and (4.1) we have: 



/•oo 

(s) = V / P{B- G dx)E, e-^^'3(-«), Js{eg-) = h, Ji{e,-) = h 

. , Jx=0 ^ 

/ / e-'yKj{x,dy)P{Bj Gdx)P{J = j), (5.1) 

Jx=0 Jv=0 



ii=i-'3 

i2,i3 



E 

ii=i-'3 

32, j3 



where by definition Vj{0) = P{J = j). These equations are explicit in the sense that every- 
thing at the right-hand side is known. Since the corrections Bj we consider are exponentially 
distributed, and the kernels kj ultimately depend on the scale functions, which are again a 
sum of exponentials, the right-hand side reduces to simply integrating exponential functions. 
The computations, although lengthy, are straightforward. Below we give some intermediate key 
steps towards the final result. 

Since the corrections may depend on the lower threshold, we need to compute all eight 
transforms vj, which reduces to computing the double integral at the right-hand side of (5.1) 
for all four kernels kj from Lemma 3.6, and then computing the resulting equations at s = in 
order to determine the unknown probabilities P{J = j). This procedure will result to a linear 
8x8 system which uniquely determines the unknown constants. 
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For simplicity, define 



poo poo 

ZTis)= / / e~'yKj{x,dy)P{Bjedx). 

Jx=0 Jv=0 



We then have: 



zns 



K rK 



e-'yp{B-. G dx)q 



x=L J y=L 



wlf{K-x)wlf{y-L) ■ 
— 1—^ W, [y — x) 



see also Lemma 3.6. Observe that in this case the two thresholds have not been crossed, which 
means that no mass is assigned outside [L,i^]. Straightforward computations lead to 



j,m=l 



s - qi. 



3,« 



^1 + 



n=l 



s-qi 



3,^1 



^1 /'g-(s+Mj)i _ g-(s-gi3,„)L-(Mj+gi3,n)i^ 



-{s+tM-AL _ -{s+^i-.)K 



Likewise, 



i=l 



2 



I _ Q-{'>-gi3.m)K 



3,m 



and 



l3,m 



{S - qi3,m){^j + qi3,i + S) {S- qi3,m){iJ'-j + qi3,i + qh,m) 



-{li-.+s)L_ 



s-^hiq) 



ifij + ^i3{q)){fi-j + s) ^^^''''(s - qi3,i){s - ^i3iq)) 



qi3,i - '^hiq) 



Finally, 

2l,l,i3('S) 



f^i + ^hiq) 



+ s){Hj + s + <l>i3{q) - qi3,i) \fij + <^i3{q) ' s 



qisA-'^hiQ) ( q 



^0,0,i3(^)- 



+ 



^m,n,/3 \^) ■ 



77i,nS{0,l} 

mn=0 



5.2 A TCP-like control 

In this subsection we consider the following situation: we take L = 0, K = oo and have 
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This case is a generalisation of a model for the throughput behaviour of a data connection 
under the Transmission Control Protocol (TCP) where typically the Levy process is a simple 
deterministic drift; see for example [1, 12, 19, 20] and references therein. 

We additionally assume the workload input is changed according to the following rule: the 
input is set to state 1 if the workload process reaches 0. Thus, F^'^\u,j) = j2, with L = and 
K = oo. The special case where the input process is kept constant is analysed in [24]. 

Our general framework simplifies as we can drop the environment parameter w.r.t. K and 
simply keep track of states of the form {u,ji,jE)- Thus, the workload level is always shrunk 
by a factor 6 and the input process is set to 1 if and only if the system emptied, otherwise the 
input process is set to 0. 

Define Vij{s) = E[e~^^; Js = i,JE = j]- Observe that 



Since 



/■oo roo 

,ais) = V / P{6U Gdx;J= ia,j)) / e-^J'P,.(X,(e,) G dy; Tq" > e^). 

„• Jx=0 Jv=0 



Px{Xa{eq) G dy;TQ > eg) = Px{Xa{eg) G dy) - Po{Xa{eg) G dy)P^{TQ < eg), 
we obtain 

/•oo _ 

vo^{s) = V / P{5U G dx; J = (a, j)) E[e-'^^'^^'''^+''^] - E^[e-'>^o]E[e-'^'^^'''^] 

t-co 

V / P{6Uedx;J = {a,j))[e-'^-e-'t"^^''>] 

^Ja[S) '—f Jx=0 



^^IVajiSs) - Vaj{d(l)a{q))]. 



q - il^ais, ^ 
Using similar arguments we get 

roo roo 

viais) = V / P{5U G dx; J = (a, j)) / e-'^ P,{Ya{eg) G dy, < e,) 

j Jx=0 Jy=0 
/"CO /" oo 

= V / P{5U G dx; J = (a, j)) / e"^J'Po(i^a(e,) € dy)P,{T^ < e, 

j Jx=0 Jy=0 

= E rn5C/edx;J=(a,j))-^^^^e-^^(^)^ 
q s- (j)a{q) 



Yvaj{d(l)a(,q)). 



To solve these equations, we need to consider two issues. First, we need to determine the 
unknown constants Vij{64>i{q)). In addition, the equation for fo,o(s) is of the form f{s) = 
g{s)f{6s) + h{s). Such an equation has the solution 

oo oo k—1 

j=0 k=0 j=0 

yielding for our case 

oo oo k 

voois) = i;oo(o) n — run + ^Ms's) - vom) n — TUf-y (^-2) 
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The infinite product is well defined since iPq{5^ s) — )■ V'o(O) = 1 geometrically fast as j — > oo. 
Note further that 



voiis) 



vw[s) 



vuis 



q-iplis) 
q s- (^o(g) 

4>o{q) V'o(s) - q 

q s-(t)i{q) 

4>i{q) V'i(s) - q 



[vio{Ss) + vii{Ss) - vio{6(f)i{q)) - vu{6(f)i{q))], 
[vooiHoiq)) + Vol {6 (q))], 

[vioi6Mq)) + viii^Mq))]- 



We now sketch how one can obtain eight equations to solve for the unknown constants Vij{S(l)i{q)), 
and Vij{0), i,j = 0, 1. Three equations can be obtained by setting s = in the expressions for 
voi{s), vio{s), vii{s). The fourth equation is Ylij %(0) = 1- Next, rewrite (5.2) by plugging in 
the expression for viq{-). Then, the last four equations can be obtained by taking s = 4>i{q) in 
the equation for Vij{s). 

5.3 An inventory model 

Consider a spectrally positive Levy process with '^'(0) < (negative drift) with the additional 
feature that extra content is fed into the system as soon as it drops below level L. This has 
to be ordered, and comes with a delay which is exponentially distributed with rate q. If such 
an order is outstanding, it is not possible to make another order. The extra amounts consist 
of i.i.d. random variables, distributed according to a generally distributed random variable B 
with LST P{s), for which we assume P{B > L) = 1. This model fits into our framework with 
K = 00 , il^o = il^i (so we drop the subscript), and F^^^x,ji) = x + jjB (we can drop the indices 
js and Je)- 

Define Vj{s) = E[e~^'^; Jj = j]. We obtain the following equations for vq{s) and vi{s). 



Vl( 



j=0 

1 



dP{U + Bj xJi = j)E, e-^^(^^)l(ri < 



x=0 



Ms) = I dP(?7 + Bj ^ xJi = j)E^ e~'^^'"h{TL > e,) 

j=0 



x=0 



This equations can be simplified by exploiting the fact that B ^ L and U ^ L if Jj = 0: the 
measure dP(U + Bj ^ xJj = j) assigns no mass to [0, L] in this case. For x > L, we can write 



Err 



Err 



-sY{e,) 



I{tl < eg) = P:,{tl < eq)EL[e 



-<t>{q){x-L) 



El[^- 



I{rL > e,)] = S,[e-^^(^'')] - P,{tl < eg)EL[e 



■sXiCq)] 



q-ipis) q-ipis) 
Substituting these expressions in the equations for Vj{s), we obtain 



1 Q-mi^^-L) ^ 



q - V'(s) 



vo{s) + mviis) - e-^(^-'^('?)) {voim) + mq))vi{Hq))) 



This is a system with two equations and two unknowns, apart from the additional unknown 
constant w{(j){q)), with 

w{s) = vo{s) + vi{s)(3{s), 
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which is the workload LST after correction. This constant can be obtained exphcitly. Observe 
that 

w{s) = /3(s)e^<^('')^L[e-^^(^')]w;(0(g)) + ^[w{s) - e-^('^-<^(''))t/; (</>((/))], 

from which we obtain 

Since w{0) = 1, we can apply rHospital's rule to obtain 

^*(,))^e-«<..(:.™™!i)l)-'. 

6 Tail behaviour 

In this section we consider the tail behaviour of V = V{oo), under a variety of assumptions on 
the tail behaviour of the Levy measure u. We will follow ideas included in [21]. 

Before we present our main results, we first state some useful preliminary results. Again, 
we exploit that, by PASTA, V has the same law as U. 

Lemma 6.1. The following (in) equalities hold (in distribution): 

U^Y. max{F(i)([/,J) + X,(e,),X,(e«)}l(F(2)(C/,J) = i), (6.1) 

j=0,l 

P{U >x)=Y, P{F^^\U,J) = i)(p{X,{e,) + F^'HU,!) > x) 

i=0,l ^ 

+ ^"(P(Zi(eg) >x)-P(Zi(eg) >x + y))P(-X,(e,)-F«([/,J) Gdy)^, (6.2) 
P{U >x)^Yl P{F^^\U,'J) = i) 

j=0,l 

(p(Xi(eg) + F^^\U,J) >x) + PiMeg) > x)P{-Xi{eg) > F^^\U,J))') , 

(6.3) 

P{U >x)^Yl [nMe,) > x)P{-Me,) > F'-'Hu,!))) P{F^'\u,J) = i). (6.4) 

j=0,l 

Proof. liUn = z and {Js,n, Ji,n, JE,n) = j, we see that Un+i = Yi{eq), with Yi{0) = F^\z,j) 
and i = Fn (z^j) {i = 0, 1). Further, we have: 

Yi{t) = max{yi(0) + Xi{t),Xi{t)}; 

for details see [21, Lemma 3.2]. This identities produce Equation (6.1). The other inequalities 
follow straightforwardly from (6.1). □ 

We now turn to the tail behaviour of U. For z = 0,1, let nj(^) = i'i{—A) be the Levy 
measure of the spectrally positive Levy process Xi (with support on R+). We first investigate 
the case where the Levy measure is a member of the convolution equivalent class iS*-"^ defined 
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below. For a ^ 0, we say that the measure 11 is convolution equivalent (11 G S^"^) if for fixed y 
we have that 

n(li — y) ™, TTT ■ 1 ■ 

nm — - — = e it 11 is nonlattice, 

M-s-oo n(u) 
n(n — 1) 

hm — - — = e", if n is lattice with span 1, 



n(n) 



and 



lim = 2 / e"^n(dy), 

t-^oo U[U) Jo 



where * denotes the convolution operator and n(n) = n((n,oo)). When a = 0, then we are in 
the subclass of subexponential measures and there is no need to distinguish between the lattice 
and non-lattice cases (see [6]). We recall now [21, Lemma 5.4]. 

Lemma 6.2. Assume that for i = 0,1 we have Hi G 5'-"'^ and il^i{ai) < q for ipi{ai) = 
log£;e"»^'(^). Then 

PiMe,) > x) ~ i^iM±^n,(x), 

where f{x) g{x) means that Wmx-^a^ f {x) / g{x) = 1. 

If G G tS*-"^ then G{u) = e"^L{u) for a slowly varying function L. Hence, for Gi G 5^"'^ 
(i = 0, 1) with ao < we have Gi{u) = o{Go{u)). Similarly, Go{u) = o{Gi{u)) for ai < oq. 
Moreover, it is known [10] that if for independent random variables xi (' = 1) 2) we have P{xi > 
u) ~ ciG{u) as ti ^ oo and G G then P{xi + X2 > ~ (ci^e"^^ _^ c2Ee°'^^)G{u). Let 

a = max{ao, ai} and combine the above observations with (6.2) in Lemma 6.1 and Lemma 6.2 
to obtain the following main result. 

Theorem 6.1. Assume that Hi G 5^°'^ and ipi{a) < q for i = 0, 1. Moreover, let F^'^\y,j) ^ 
Po{^ 0) for any y and j, and assume that there exist constants Cj ^ such that P{F^^\y,j) > 
x) ~ P{Fq > x) ~ CiYli{x) as X ^ oo for each y and j (If q = then P{F^^\y, j) > x) = 
o{Ili{x))). Then 

p{u >x)^Yl An,(x), 

1=0,1 

as X ^ oo, where 

A = Q '—-PiF('Hu,J) = ^) + ^-—^Ee'^^^''W^PiF('\U,J) = ^) 

q-ipiiai) {q-il!i{ai)Y 

+ ^^£M±^p(i.(2)(^J) = i)E(l- e-»A-M-F^'\u,J)) 

{q-i>i{a.i)Y ^i{q) ^ ^ ' ' \ 

P i-Meq) - F^'\U, J) > 0, F(2)(f/,J) = 



The conditions in this theorem are satisfied by both examples F^'^\y,j) = (in which case, 
we take Fq = 0, q = 0) and F^'^\y,j) = {Bi — y)+ (where Fq = Bi). If Ilj is subexponential for 
at least one a,- (i.e. Hi G 5^), then 



P{U > x) ~ V fc, + -\ tiiix 
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We consider now the Cramer case (light-tailed case). Assume that for each i = 0,1 there 
exists ^i{q) such that 

MMq)) = Q (6.5) 



and that 



9/3 



< oo, (6.6) 

/3=-1'»(9) 



where K{g,Q is the Laplace exponent of a ladder height process {{L- ^ (t), Hi{t)),t ^ 0} of Xi, 
that is: 

Note that if Ilj S S{a) and il^i{a) < q, then condition (6.5) is not satisfied. Moreover, we assume 
that 

Se*-('')^'^Hf/,J) < oo, i = 0,l. (6.7) 

Theorem 6.2. Assume that (6.5)-(6.7) hold and that the supports of Hi (i = 0, Ij are non- 
lattice. Then, as x ^ oo, either 

P{U > x) ~ Ce-*(«)^ 



if^oio) + ^1(9), where ^{q) := min{$o(g), ^i(g)}, 

C- 



Co /or $0(9) < ^i(g), 
Ci for^o{q)>^i{q), 



for 

Ci=p(-X,{eq)> F^^\U,1) and F^^\U,1) = i] K{q,0) {^i{q)mi{q)r\ i = 0, 1, 



and 

P{U>x) - (Co + Cl)e-*('?)^ 

otherwise. 

Proof. From the proof of [21, Th. 5.2] it follows that 

Ki{q,0) 



lim e*^('')^'P(Xi(eg) > 



^{q)mi{q)' 



Note that by (6.5) and (6.7), we have P(Xi(eq) + F'-^\U,J) > x) = o(e-*»('?)^). Inequalities 
(6.3) and (6.4) in Lemma 6.1 complete the proof. □ 
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